(19) 



J 



t^^ter 



(12) 



(43) Date of publication: 

15.09.1999 Bulletin 1999/37 



Europdische^Htentamt 

European Patent Office 
Office europten des brevets (11) EP 0 942 603 A2 

EUROPEAN PATENT APPLICATION 

(51) IntCI. 6 : H04N7/24 



(21) Application number: 99301761.5 

(22) Date of filing: 09.03.1999 



(84) Designated Contracting States: 


(72) Inventor: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


Kitamura, Takuya, 


MCNLPTSE 


Intellectual Property Department 


Designated Extension States: 


Shinagawa-ku, Tokyo 141 (JP) 


AL LT LV MK RO SI 






(74) Representative: 


(30) Priority: 09.03.1998 J P 05712198 


Homer, David Richard et al 




D Young & Co, 


(71) Applicant: SONY CORPORATION 


21 New Fetter Lane 


Tokyo 141 (JP) 


London EC4A 1 DA (GB) 



(54) Video splicing apparatus and video splicing method 



(57) A video splicing apparatus is provided for 
receiving a transport stream including a plurality of 
packetized encoded video data streams, and for splic- 
ing the encoded video data streams to generate a 
spliced video data stream. The video splicing apparatus 
includes an input processor for disassembling each of 
the plurality of packetized encoded video data streams 
in the transport stream into a pseudo-elementary 
stream before packetization, and for storing the disas- 
sembled pseudo-elementary streams in predetermined 
storage. An analyzer is also provided for analyzing the 
amount of coded bits of two data streams of the pseudo- 
elementary streams stored in the storage that will be 
generated upon decoding upon receipt of the two data 



streams to be subjected to a splicing operation. A data 
processor is provided for reading the data streams to be 
subjected to the splicing operation from the storage, 
splicing the streams, and inserting a desired amount of 
additional data at a splice point based on the result of 
the analysis by said analyzer to produce a spliced video 
data stream and storing the spliced video data stream in 
the storage. An output processor is provided for deter- 
mining output timing for the spliced video data stream 
based on the determined amount of coded bits, and out- 
putting the spliced video data stream read from the stor- 
age based on the output timing. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates generally to a s 
video splicing apparatus and a video splicing method 
and more particularly to a video splicing apparatus and 
a video splicing method that are particularly suitable for 
switching and connecting packetized encoded video 
data streams, for example transport stream (TS) pack- 10 
etized video data. 

[0002] A variety of compression encoding schemes 
have been proposed as techniques for reducing the 
amount of information necessary to encode and repre- 
sent video images and audio information associated 75 
therewith. A representative one of such compression 
encoding schemes is called Moving Picture Experts 
Group Phase 2 (MPEG2) that has been standardized by 
institutes such as the International Organization for 
Standardization (ISO) and so on. The MPEG2 compres- 20 
sion encoding scheme has been standardized for pur- 
poses of transmitting video and audio data, and 
includes separate standards for video and audio data, 
respectively. 

[0003] Digital broadcasting systems have recently 25 
been devised for compression encoding video and 
audio data using the MPEG2 compression encoding 
scheme to transmit broadcast compression encoded 
data using ground or satellite waves. In operation, such 
a digital broadcasting system packetizes encoded video 30 
data and associated audio data for every predetermined 
block of data for transmission, and transmits a resulting 
sequence of packets in a transport stream. (The packet 
sequence is hereinafter referred to as the "transport 
stream" and each packet forming the transport stream is 35 
hereinafter referred to as a transport stream (TS) 
packet). 

[0004] Making reference first to Figs. 1A to 1D, the 
relationship between video data, audio data and TS 
packets will be explained. While a description of only the 40 
video data will be given, the same basic concept is 
applicable to both video and audio data. As is shown in 
Figs. 1A and 1B, in accordance with the MPEG2 com- 
pression encoding scheme, several consecutive pic- 
tures are defined as one group of pictures (GOP), such 45 
that video data is compression encoded in units of GOP. 
At least one of the pictures in each GOP is defined as 
an I -picture and is compression encoded by irttra-frame 
encoding, while each remaining picture is defined as 
either a P -picture and is compression encoded by inter- so 
frame predictive encoding from the I -picture or another 
P -picture; or a B-picture and is compression encoded 
by bi-directional inter-frame predictive encoding from 
either I, P or B-pictures located before and after the B- 
picture. 55 
[0005] A plurality of encoded video data in GOP units 
are generally referred to as an "elementary stream 
(ES)" because this combination of encoded video data 
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represents a material data element As illustrated in 
Figs. 1Band 1C. the encoded video data GOPs are col- 
lected and placed in consecutive locations. A header is 
added at the head of the collection of the encoded video 
data GOPs to form a packetized elementary stream 
(PES). As is further illustrated in Figs. 10 and 1D, the 
PES is divided every 184 bytes, and a 4-byte header is 
added to the head of each divided 184 byte packet In 
this manner, the PES is transformed into a plurality of 
TS packets for transmission, the TS packets including 
the video data. 

[0006] As is illustrated in Fig. 2, a header provided 
with each of the PES packets comprises a 24-bit packet 
start code indicative of the start of the PES packet; an 8- 
bit stream ID indicative of the type of data stream con- 
tained in a data portion of the PES packet (for example, 
the type such as video, audio, or the like); a 16-bit 
packet length indicator that is indicative of the length of 
subsequent data portion; code data set to the value 
"1 0"; a 1 4-bit flag control field for storing a variety of flag 
information; an 8-bit PES header length variable indica- 
tive of the length of data in a following conditional coding 
field; and a variable-length conditional coding field for 
storing time management information such as timing 
information for use during reproduction and output 
called a presentation time stamp (PTS), time manage- 
ment information used during decoding called a decod- 
ing time stamp (DTS), other time management data, 
and stuffing bytes, as necessary, for adjusting the 
amount of data or the like. 

[0007] Referring next to Fig. 3, the 4-byte header of 
each TS packet comprises an 8-bit synchronization byte 
indicative of the start of the TS packet; an error display 
field indicative of the presence or absence of bit errors 
in the packet (error indicator field); a unit start display 
field indicative of whether or not the head of a PES 
packet exists in this TS packet; a transport packet prior- 
ity field indicative of relative significance of this TS 
packet; a PID field for storing packet identification infor- 
mation (PID) indicative of the type of data stream con- 
tained in a payload field of this TS packet; a scramble 
control field indicative of whether or not the data stream 
contained in the payload field is scrambled; an adapta- 
tion field control field indicative of whether or not an 
adaptation field area and a payload area exist in this TS 
packet; and a cyclic counter field for storing cyclic coun- 
ter information indicative of whether or not a TS packet 
having the same packet identification information PID 
has been discarded. 

[0008] An adaptation field area for storing a variety of 
additional control information is also provided. The 
adaptation field area in turn includes an adaptation field 
length field area indicative of the length of the adapta- 
tion field area itself; a discontinuity display field indica- 
tive of whether or not timing information is to be reset in 
a TS packet of the same data stream subsequent to this 
TS packet; a random access display field indicative of 
whether or not this TS packet is an entry pant for ran- 
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dom access display of the data stream; a stream priority 
display field indicative of whether or not the payload 
area of this TS packet contains a significant portion of a 
data stream; a flag control field for storing flag informa- 
tion related to a conditional coding field; a conditional 5 
coding field for storing various reference time informa- 
tion including a program clock reference (PCR) and an 
original program clock reference (OPCR), information 
such as a splice count down indicative of the number of 
bytes until a data exchange point; a transport data 
length indication, and an adaption field extension indic- 
ative of whether additional adaption field information is 
to be provided; and a stuffing byte field inducting a plu- 
rality of stuffing bytes, as necessary, for adjusting the 
amount of data. 

[0009] When transmitting data compression encoded 
information employing the MPEG2 compression encod- 
ing scheme, because data to be transmitted is trans- 
formed into TS packets for transmission, as mentioned 
above, TS packets generated from other data may be 
multiplexed with the original generated TS data to be 
transmitted, and the combined data stream may be 
transmitted in a multiplexed manner. For this reason, a 
digital broadcasting system first compression encodes 
video and associated audio data of respective programs 
in accordance with the MPEG2 compression encoding 
scheme, then transforms this compression encoded 
data into TS packets, and finally multiplexes these TS 
packets with TS packets including data from other pro- 
grams so that a plurality of programs can be broadcast 
through one line. 

[0010] When a plurality of programs are multiplexed 
together and are transmitted on a single line, a receiver 
that receives such a multiplexed data stream must 
extract and decode the TS packets containing video and 
audio data of a single viewer desired program from all of 
the multiplexed TS packets sent in the single multi- 
plexed data stream. In order to properly perform this 
process, the digital broadcasting system also trans- 
forms various program information, including a program 
association table (PAT) and a program map table (PMT), 
into TS packets which are then multiplexed and trans- 
mitted with the stream of TS packets associated with 
video and audio data, as descrfoed above. 
[001 1 ] The program information PMT includes packet 
identification information PID for each broadcast pro- 
gram information indicative of which of the TS packets 
contain video data and audio data forming part of a par- 
ticular program. For example, for a program number "X", 
video data associated with this program number is iden- 
tified with packet identification information PID "XV" and 
audio data associated with this program number is iden- 
tified with packet identification information PID "XA." 
Because program information PMT is provided for each 
program that is multiplexed together and transported in 
one multiplexed data stream, the number of program 
information PMT is equal to the number of programs 
multiplexed in a single multiplexed transport stream. 



[0012] The program information PAT includes packet 
identification information PID for each of the broadcast 
programs indicative of which of the TS packets stores 
program information PMT for each program. For exam- 
ple, a TS packet storing program information PMT asso- 
ciated with program number "0" is identified by packet 
identification information PID "AA," and a TS packet 
storing program information PMT associated with pro- 
gram number "1" is identified by identification informa- 
tion PID "BB." A TS packet which contains the program 
information PAT is additionally provided with predeter- 
mined packet identification information PID. 
[0013] When a receiving apparatus employed by a 
viewer receives a multiplexed transport stream having a 
plurality of programs multiplexed therein and a desired 
program is to be displayed, the viewer first receives at 
the receiver a TS packet which contains the program 
information PAT The receiver extracts the TS packet to 
acquire the program information PAT. Then, the receiver 
employed by the viewer references the acquired pro- 
gram information PAT to determine which of a plurality 
of TS packets contains the program information PMT of 
the desired program and to allow the receiver to acquire 
the program information PMT of the desired program. 
The receiver thus extracts the program information PMT 
of the desired program. Then, the receiver selects the 
TS packets that contain video data and audio data of 
the desired program from the TS packet data stream by 
referencing the acquired program information PMT, to in 
turn acquire the TS packets containing the actual video 
and audio data forming the desired program. The 
acquired video and audio data is then decoded for dis- 
play. In this manner, the receiver can receive and dis- 
play any program desired by the viewer even if a 
plurality of programs are multiplexed together and are 
transported in a serial manner in a multiplexed transport 
stream. 

[0014] According to one aspect of the digital broad- 
casting system as described above, it is contemplated 
that a multiplexed transport stream will be received at a 
local broadcast station, and that advertising video data 
(so-called CM), for example, will be inserted into video 
data of a predetermined program within the transport 
stream. After this insertion procedure is complete, the 
transport stream with the advertising video data 
inserted therein is retransmitted. It is also contemplated 
that additional video data may be spliced to video data 
of a desired program within a transport stream, prior to 
final transmission, rather than being inserted within the 
video data of the desired program to be displayed after 
the transport stream has been produced at a main 
broadcasting station. The resulting transport stream is 
eventually transmitted from the local broadcasting sta- 
tion after the new data has been added thereto. As is 
illustrated in Figs. 4A to 4C, in order to perform such an 
editing operation, original video data S1 and video data 
S2 to be inserted into video data S1 or connected to 
video data S1 must be switched and connected to pro- 



15 



20 



25 



30 



35 



40 



45 



50 



3 




EPO 



duce video data S3 which is intended for final transmis- 
sion. Such a video editing operation is generally 
referred to as a "splicing operation." 
[0015] When baseband video data not subjected to 
compression encoding is to be spliced, the editing oper- 
ation can be readily carried out by switching the frame 
timing between the first and second video data S1,S2in 
synchronism. However, if the first and second video 
data have been compression encoded and then trans- 
formed into TS packets as mentioned above, the 
amount of information used to represent each picture 
differs from picture to picture. Thus, because the chang- 
ing points of images are not at equal intervals as is the 
case of conventional frames, difficulties in performing 
the splicing operation are caused. 
[001 6] Also, when a TS packetized transport stream is 
transmitted, the rate of the data transmission is control- 
led to prevent a video buffering verifier (VBV) buffer of a 
system target decoder (STD) buffer, provided at an 
input stage of a receiver, from overflowing or underf low- 
ing. Thus, simply switching the data input from the first 
video data to the second video data may possibly cause 
the STD buffer to overflow. For example, as illustrated in 
Figs. 5A to 5C, if the first and second coded video data 
S1 , S2, controlled to prevent the VBV buffer from over- 
flowing, are simply switched at the timing of time point tl 
to produce the third coded video data stream S3, a time 
period t2 from the decoding of the last picture m of the 
first coded video data S1 to the decoding of the first pic- 
ture n of the second coded video data S2 exceeds 1/30 
of a second, thereby causing the temporal relationship 
between the first and second coded video data S1 , S2 
to be discontinuous before and after a connection point 
t1. In addition, if video data is extracted from the STD 
buffer at intervals of 1/30 seconds in such a discontinu- 
ous state the STD buffer will underflow in the near 
future. 

[0017] Thus, the use of TS-packetized video data 
results in a problem that a splicing operation cannot be 
performed simply by switching video data from a first 
video data stream to a second video data stream. 
[0018] It is therefore an object of this invention to pro- 
vide an improved video splicing apparatus and a 
method associated therewith that alleviate the draw- 
backs of the prior art 

SUMMARY OF THE INVENTION 

[001 9] Particular and preferred aspects of the present 
invention are set out in the accompanying independent 
and dependent claims. Features of the dependent 
claims may be combined with features of the independ- 
ent claims as appropriate, and in combinations other 
than those explicitly set out in the claims. 
[0020] In accordance with an embodiment of the 
invention, a video editing apparatus is provided for 
receiving a video data transport stream, including a plu- 
rality of packetized encoded video data streams multi- 
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plexed together, and for splicing a desired encoded 
video data stream to the received video data transport 
stream. The video editing apparatus comprises an input 
processor for disassembling each of the packetized 

5 encoded video data streams of the received video data 
transport stream into a form similar to an original ele- 
mentary data stream (before packetization), and for 
storing each disassembled elementary data stream in 
predetermined storage. An analyzer is provided for ana- 

w lyzing the amount of coded bits that will be generated 
upon receipt for each data stream to be spliced to one 
of the elementary data streams stored in the predeter- 
mined storage. A data processor reads the data 
streams to be spliced to one of the elementary data 

75 streams from the predetermined storage. The elemen- 
tary data stream and the data stream to be spliced to 
the elementary data stream are spliced and a desired 
amount of stuffing data is inserted at a splice point 
based on a result of the analysis by the analyzer, to pro- 

20 duce a combined, continuous video data stream. The 
combined video data stream is then stored in the prede- 
termined storage, and an output timing for the combined 
video data stream is determined based on the amount 
of code bits that will be generated upon receipt for the 

25 combined video data stream. The combined video data 
stream is finally read from the predetermined storage 
and is output based on the determined output timing. 
[0021] In accordance with embodiments of the inven- 
tion, respective encoded video data streams within the 

30 received video data transport stream are disassembled 
into their respective original elementary data streams, 
and are stored in the predetermined storage. The 
amount of coding bits that will be generated upon 
receipt for data streams to be spliced to the plurality of 

35 elementary data streams is analyzed, and based on the 
result of this analysis, the streams are spliced together, 
and a required amount of stuffing data is inserted at a 
link point to produce a continuous combined video data 
stream. The combined video data stream is output in 

40 accordance with an output timing determined on the 
basis of the amount of coding bits that will be generated 
upon receipt of the combined video data stream at a 
receiver. Thus, in accordance with embodiments of the 
invention, it is possible to readily carry out data connec- 
ts tion/splicing processing even with digital video data 
which is packetized for transmission, without causing a 
buffer in a receiver to underflow or overflow, and without 
causing a tiscontirtuity in the output data. 
[0022] The apparatus and method of embodiments of 

so the present invention allow for the splicing of TS-pack- 
etized video data while avoiding the risk of the produc- 
tion of discontinuous video data, or an underflow or 
overflow of the STD buffer. 

[0023] An embodiment of the invention provides an 
55 improved video editing apparatus and method that can 
readily perform a splicing operation of coded digital 
video data that has been packetized for transmission. In 
preferred embodiments, the apparatus and method 
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avoid a discontinuity in the output data in the vicinity of 
the splicing operation. Further, the apparatus and 
method avoid underflow or overflow of a VBV buffer pro- 
vided in a system target decoder (STD) buffer. 
[0024] The invention accordingly comprises the sev- 
eral steps and the relation of one or more of such steps 
with respect to each of the others, and the apparatus 
embodying features of construction, combinations of 
elements and arrangement of parts that are adapted to 
effect such steps, all as exemplified in the following 
detailed disclosure, and the scope of the invention will 
be indicated in the claims. 

[0025] Still other objects and advantages of the inven- 
tion will in part be obvious and will in part be apparent 
from the specification and drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0026] The present invention will be described further, 
by way of example only, with reference to preferred 
embodiments thereof as illustrated in the accompanying 
drawings, in which: 

Figs. 1A to 1D are schematic diagrams used for 
explaining the structure of video data and a TS 
packet employed in a standard apparatus; 
Fig. 2 is a schematic diagram illustrating the struc- 
ture of a PES packet employed in a standard appa- 
ratus; 

Fig. 3 is a schematic diagram illustrating the struc- 
ture of a TS packet employed in a standard appara- 
tus; 

Figs. 4A to 4C are schematic diagrams used for 
explaining the concept of a splicing operation 
employed in a prior art device; 
Figs. 5A to 5C are schematic diagrams of an occu- 
pancy of a VBV buffer used for explaining a draw- 
back arising from a conventional splicing operation; 
Fig. 6 is a block diagram illustrating the configura- 
tion of a splicing apparatus constructed in accord- 
ance with an embodiment of the invention; 
Figs. 7A to 10 are schematic diagrams of an occu- 
pancy of a VBV buffer used for explaining a splicing 
operation in accordance with an embodiment of the 
invention; 

Figs. 8A to 8D are schematic diagrams of data 
streams used for further explaining the splicing 
operation in accordance with an embodiment of the 
invention; 

Fig. 9 is a block diagram illustrating the configura- 
tion of signal input processor constructed in accord- 
ance with an embodiment of the invention; 
Fig. 10 is a diagram showing a data structure for- 
mat when stored in a memory constructed in 
accordance with an embodiment of the invention; 
Fig. 1 1 is a block diagram illustrating the configura- 
tion of a sync detector circuit constructed in accord- 
ance with an embodiment of the invention; 
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Fig. 12 is a schematic diagram showing the struc- 
ture of a PID lookup table in accordance with an 
embodiment of the invention; 
Fig. 13 is a block diagram illustrating the configura- 

5 tion of a PID lookup table circuit constructed in 
accordance with an embodiment of the invention; 
Fig. 14 is a block diagram illustrating the configura- 
tion of a parser unit constructed in accordance with 
an embodiment of the invention; 

10 Fig. 1 5 is a block diagram illustrating the configura- 
tion of a data link circuit constructed in accordance 
with an embodiment of the invention; 
Fig. 16 is a block diagram illustrating the configura- 
tion of an output processor constructed in accord- 

15 ance with an embodiment of the invention; 

Fig. 17 is a flew chart illustrating a processing pro- 
cedure for a splicing operation in accordance with 
an embodiment of the invention; 
Figs. 18A to 181 are timing charts of a processing 

20 schedule performed in various circuit elements in 
accordance with an embodiment of the invention; 
Fig. 19 is a diagram depicting the determination of 
the required blanking and stuffing information 
required for a splicing operation in accordance with 

25 an embodiment of the invention; and 

Fig. 20 is a flow chart depicting the procedure to be 
followed in making the determinations in Fig. 19. 

DETAILED DESCRIPTION OF THE EMBODIMENT 

30 

(1) General Configuration of a Splicing Apparatus Con- 
structed in Accordance with an embodiment of the 
Invention. 

35 [0027] Referring first to Fig. 6, a splicing apparatus 1 
is shown. In accordance with an embodiment of the 
invention, control information is supplied from an exter- 
nal host computer 2, and in accordance therewith, splic- 
ing apparatus 1 splices together pre-selected programs 

40 from multi-program transport streams S10, S1 1 . Splic- 
ing apparatus 1 preferably resides in a main broadcast- 
ing station or in a local broadcasting station within a 
digital broadcasting system and operates to splice 
together video data of two different programs which 

45 have each been previously transformed into transport 
streams for transmission. 

[0028] Making further reference to Fig. 6, the principle 
of a splicing operation performed in splicing apparatus 1 
in accordance with an embodiment of the invention will 

so be explained. Assume first that the transport stream 
S10 is multiplexed with digital video data of three pro- 
grams A, C, E, while the transport stream S1 1 is multi- 
plexed with digital video data of three programs B, D, F, 
and video data DB of program B is to be spliced into 

55 video data DA of program A When transport streams 
S10, S1 1 are input to splicing apparatus 1 , the splicing 
apparatus first rearranges and groups respective video 
data within transport streams S10, S11 for each pro- 
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gram based on packet identification information PID 
included within transport streams S10, S11. The loca- 
tion packet identification information PID for each pro- 
gram in the transport stream may be recognized 
according to program information PAT and program 5 
information PMT also included with each transport 
stream, as noted above. 

[0029] When the video data DA, DB of the programs 
A, B are spliced together, the video data is controlled so 
that a VBV buffer in a receiver of the spliced data will not 10 
overflow or underflow. As is illustrated in Figs. 7A and 
7B, when the video data DA is spliced to the video data 
DB at time point t1, the video data DA is not simply 
switched to the video data DB. Rather, as illustrated in 
Rg. 7C, three blanking pictures B1 to B3 are inserted 75 
after the video data DA, and stuffing data SF is inserted 
to produce a spliced video data DAB such that the video 
data DA and the video data DB appear continuous 
before and after the splice point t1 . Consequently, when 
the spliced video data DAB is multiplexed with video 20 
data of other programs C, E and transmitted, the VBV 
buffer at the receiver side of the apparatus will not over- 
flow or underflow as in the prior art apparatus even if the 
video data DAB is extracted at intervals of 1/30 seconds 
from the VBV buffer at the receiver. In this example, 25 
three blanking pictures are displayed between a last pic- 
ture m of video data DA and a first picture n of video 
data DB. Stuffing data SF is mere dummy data for time 
adjustment, and is discarded by the receiver after the 
spliced video data DAB is extracted from the VBV buffer 30 
at the receiver end. 

[0030] The video data DA and DB are TS-packetized 
data multiplexed in the transport streams S10, S11, 
respectively, ff the complete video data DA and DB were 
each stored in one TS packet, the splicing operation 35 
could easily be performed in units of TS packets. Actu- 
ally, however, since the capacity of a TS packet is small, 
i.e.. 188 bytes, the complete video data DA and DB are 
each stored over a plurality of TS packets. For this rea- 
son, in order to perform the splicing operation in the 40 
prior art it is necessary to completely decode the video 
data and return the video data to the format of an ele- 
mentary stream. However, if the video data DA and DB 
are returned completely to the format of elementary 
streams, they must be again transformed into TS pack- 45 
ets to be output, thus requiring complicated processing. 
To avoid such difficulties, splicing apparatus 1 of an 
embodiment of the invention converts the video data DA 
and DB, formed of TS packets, intodata having a format 
that can be handled as if formed of elementary streams, so 
but that requires far less processing than if the data 
were actually converted to elementary streams. A proc- 
essor for performing this data format conversion is 
shown at input processing unit 3 of Rg. 6. 
[0031] Referring once again to Rg. 6, explanation of 55 
splicing apparatus 1 will be continued. As is illustrated in 
Rg. 6, splicing apparatus 1 is generally composed of 
input processing unit 3; a data analysis unit 4; a data . 



processing unit 5; an output processing unit 6; a central c 
processing unit (CPU) 7, acting as a control means; a 
command bus 8; a data bus 9; a memory 10; and an 
interface unit 11. 

[0032] CPU 7 controls the operations of the respective 
circuit elements (3-6. 10) of splicing apparatus 1 . CPU 7 
receives a splicing instruction from higher-level external 
host computer 2 through interface unit 1 1 and via com- 
mand bus 8. CPU 7 then issues operation instructions 
to the respective circuit elements (3-6, 1 0) based on the 
received splicing instruction. The operation instructions 
are provided to the associated circuit elements (3-6, 1 0) 
via command data bus 8. In this manner the splicing 
operation instructed by host computer 2 is carried out. 
CPU 7 operates based upon an operation program 
stored in memory 10 to control the operation of these 
circuit elements. Trie operation program may be down- 
loaded into memory 10 through host computer 2 from 
the outside, or input into memory 10 in some other man- 
ner, by way of example. 

[0033] In splicing apparatus 1 , the respective circuit 
elements (3-7) are connected to memory 10 through 
data bus 9 such that they can write desired data into 
memory 10 and read desired data from memory 10. 
Data bus 9 is provided with an arbitration function for 
arbitrating access rights to data bus 9 so as to prevent a 
collision of requests for access to memory 10. 
[0034] Input processing unit 3 performs predeter- 
mined input processing on input transport streams S1 0, 
S11 supplied thereto from an outside source. These 
processed input transport streams are then stored in 
memory 10. Input processing unit 3 is comprised of 
input processors 15 A, 15B, and PID lookup tables 16 A, 
1 6B such that the supplied transport streams S1 0, S1 1 
are received by input processors 1 5A, 1 5B, respectively. 
[0035] Input processor 1 5A writes respective TS pack- 
ets of the input transport stream S10 into memory 10, 
making reference to PID lookup table 16A to rearrange 
and group transport stream S10 by program in accord- 
ance with packet identification information PID con- 
tained therein. The respective TS packets in transport 
stream S1 0 are then written into memory 10. Input proc- 
essor 15A performs data format conversion processing 
and records the respective TS packets that can then be 
handled as if they were elementary data streams into 
memory 10. as mentioned above. PID lookup table 16A 
stores address information for rearranging and grouping 
the respective TS packets by program in accordance 
with the packet identification information PID, and writ- 
ing the rearranged TS packets into memory 10. The 
address information can be read from PID lookup table 
16A with the packet identification information PID used 
as a key word. In this manner, input processor 15A can 
access PID lookup table 16A with the packet identifica- 
tion information PID as a key word to retrieve a desired 
write addresses in memory 10, in order to determine at 
what location in memory 10 each TS packets is stored. 
[0036] Input processor 1 5B and PID lookup table 1 6B 
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are configured substantially in a similar manner to input 
processor 15A and PID lookup table 16A, respectively. 
Input processor 15B writes respective TS packets of the 
input transport stream S1 1 into memory 10 with refer- 
ence to PID lookup table 16B to rearrange transport 5 
stream S11 in accordance with packet identification 
information PID. The respective TS packets in transport 
stream S1 1 are then written into memory 10. 
[0037] Data analysis unit 4 reads out video data DA 
and DB from memory 10 that are to be subjected to a 10 
splicing operation, and then parses the syntax of video 
data DA and DB, the PES stream and the TS packet 
stream to retrieve the MPEG, PES and TS parameters. 
Data analysis unit 4 thus reads a variety of parameters 
that have been added to the desired TS packets during 75 
compression encoding and packetization. Data analysis 
unit 4 then analyzes the amount of code that will be gen- 
erated for the video data DA and DB upon reception 
based on the retrieved parameters. 
[0038] The data analysis unit 4 comprises a parser 20 
unit 17 and a buffer simulator unit 18. Parser unit 17 
accesses memory 10 to parse the syntax of the 
encoded video data DA and DB to be spliced being 
treated as elementary streams, and the syntax of the 
PES and TS streams, and extracts a variety of parame- 25 
ters which have been added to the encoded video data 
and TS packets during compression encoding and 
packetization. Buffer simulator unit 18 in turn analyses 
the amount of code that will be generated in the VBV 
buffer at the receiver when the spliced video data DA 30 
and DB are received thereby, based on the parsing 
results derived by parser unit 17. Data analysis unit 4 
can calculate the occupancy of the VBV buffer at the 
receiver upon the receipt of video data DA and DB from 
the number of bits of the video data DA and DB and the 35 
transport bit-rate of the video data DA and DB. CPU 7 is 
notified of the result of this analysis. CPU 7, upon 
receiving the analysis result determines how the coded 
video streams should be spliced and formatted in order 
to prevent the VBV buffer of the receiver from overflow- 40 
ing or underf lowing, and notifies data processing unit 8 
of this information as a splicing instruction. The analysis 
result output from buffer simulator unit 1 8 and the data 
combination information output by CPU 7 are also sup- 
plied to a scheduler circuit 24 in output processing unit 45 
6. 

[0039] Data processing unit 5 splices the video data 
DA and DB in response to a splicing instruction from 
CPU 7. Data processing unit 8 is composed of a data 
link circuit 19; a blanking generator 20; and a stuffing so 
generator 21 . Data link circuit 19, responsive to a data 
combination instruction from CPU 7, reads the video 
data DA and DB to be spliced from memory 10. and 
splices the video data to produce combined video data 
DAB. Data link circuit 19 inserts a desired amount of 55 
blanking data and stuffing data, generated by the blank- 
ing generator 20 and the stuffing generator 21, at a 
splice point of video data DA and DB. This blanking data 



and stuffing data is inserted as necessary in order to 
prevent the VBV buffer from failing. 
[0040] It is not necessary for data link circuit 1 9 to read 
all of the video data DA and DB which are to be spliced. 
As illustrated in Figs. 8A to 8C, data link circuit 19 reads 
video data DA1 and DB1 only near the splice point as 
required for the splice processing. Thus, video data DA1 
and DB1 are spliced together, blanking data and stuffing 
data are inserted between the video data DA1 and DB1 
to produce spliced video data DA+B. This spliced video 
data is then stored in memory 10 in TS packet form. 
Spliced video data DA+B can be readily produced upon ^ 
data output by reading the video data from memory 10 
in a desired order. 

[0041] Output processing unit 6 reads and outputs a 
desired portion of video data stored in memory 10 to 
multiplex the combined video data DA+B, and video 
data that has not been spliced, such as programs C, E, 
to output the multiplexed video data as a transport 
stream Squt Specifically, output processing unit 6 
reads partial video data DA2 of video data DA, subse- 
quently reads the linked video data DA+B, and further 
reads partial video data DB2 of video data DB to output 
the spliced video data DA+B, as illustrated in Fig. 8D. In 
parallel, output processing unit 6 reads TS packets of 
video data of the unspliced programs C. E. These data 
programs are multiplexed with the spliced video data 
DA+B. TS packets containing data of C. E programs are 
inserted between respective TS packets of combined 
video data DA+B according to a predetermined timing. 
Transport stream Squt IS thus output having the spliced 
video data DAB and the video data of unspliced other 
programs C, E multiplexed therein. 
[9042] Output processing unit 6 comprises a time 
stamp regenerator 22; an output processor 23; a sched- 
uler circuit 24; and a PCR regenerator 25. Time stamp 
regenerator 22 adds a new time stamp information, 
such as PTS, DTS, and program clock reference PCR to 
the video data DB1 and DB2 which are connected after 
the splice point, and also adds required blanking pic- 
tures that are inserted between video data DA and DB 
by stuffing processing. Originally, the video data DA and 
DB each had their own time stamps added thereto to 
prevent the VBV buffer from overflowing or underflow- 
ing. However, these time stamps likely do not match 
after the splicing operation. For this reason, time 
stamps may be possibly discontinuous before and after 
the splice point. To prevent this, time stamp regenerator 
22 detects time stamps added to the video data DA up 
to the splice point from the video data DA, and adds new 
time stamps continuous from the previous time stamps 
to the video data DB1 and DB2 after the splice point. 
[0043] Scheduler circuit 24 estimates the amount of 
code that will be generated in the VBV buffer of the 
receiver upon receipt of the spliced data, and schedules 
the output timing of the TS packets of the video data 
DA2, DA+B and DB2 stored in memory 10 based on the 
analysts result output from buffer simulator 18 by CPU 
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7. Scheduler circuit 24 also schedules the output of the 
other non-spliced programs C. E. TTien, scheduler cir- 
cuit 24 outputs the scheduling result to output processor 
23 as a scheduling list. The scheduling list may include 
entry information for specifying which TS packet is to be 
output and output time information indicative of the out- 
put timing for the TS packet arranged in a list form. 
Because most of the TS packets are input and output 
without modification, scheduler circuit 24 specifies an 
output time for a TS packet according to its input time 
(i.e., the value of a system time clock STC upon input of 
the TS packet) for simplifying processing. However, for 
TS packets positioned after the splice point within the 
spliced data stream, scheduler circuit 24 assumes that 
the TS packets in the spliced data stream are input to 
splicing apparatus 1 continuously after TS packets input 
before the splice point Scheduler circuit 24 calculates, 
based upon this assumption, the value of a system time 
clock STC which is added to the input time for each of 
the TS packets, and specifies an output time for each of 
the TS packets in the spliced data stream. Output proc- 
essor 23 sequentially reads TS packets of the spliced 
video data DA+B and video data of the other programs 
C, E based on the scheduling list output from scheduler 
circuit 24, and outputs the read TS packets to PCR 
regenerator 25 as a transport stream Squt- 
[0044] PCR regenerator 25 adds a new program clock 
reference PCR to each TS packet in the transport 
stream Squt such that the program clock reference 
PCR is continuous over the TS packets. When the TS 
packets are sequentially outputted based on the sched- 
uling list produced by scheduler circuit 24, the reference 
time information PCR in the transport stream SOUT 
must be continuous. However, if output processor 23 is 
operated in accordance with an operating clock that is 
external to output processor 23, the timing at which TS 
packets are actually output may deviate from the sched- 
uling list, possibly resulting in discontinuous program 
clock reference PCR. For this reason, in splicing appa- 
ratus 1, program clock reference PCR in the transport 
stream Squt <s corrected by PCR regenerator 25. PCR 
regenerator 25 adds the value of PCRnew as the pro- 
gram clock reference PCR, in accordance with the fol- 
lowing equation: 

PCRnew = PCRold +(STCreal - STCideal) (1) 

where PCRold is the program clock reference PCR cur- 
rently added to the transport stream Squt* STCideal is 
the time at which the transport stream Squt * s sched- 
uled to be output, determined in accordance with the 
scheduling list; and STCreal is the time at which the 
transport stream Squt is actually output Transport 
stream Squt. with newly added program clock reference 
PCR, is finally output from splicing apparatus 1 . 



(2) Configuration of Input Processor 

[0045] The configuration of input processors 1 5A, 1 5B 
will be described first making reference to Fig. 9 in addi- 
s tion to Fig. 6. Because input processors 15A, 15B have 
a similar configuration, only input processor 15A will be 
described. 

[0046] As illustrated in Fig. 9. input processor 15A 
comprises a sync detector circuit 30; a format conver- 
ge sion circuit 31; and a PID detector circuit 32. Sync 
detector circuit 30 detects a synchronization byte code 
f 47H") added at the head of each TS packet in a trans- 
port stream S1 0 inputted thereto to detect the beginning 
of each TS packet. A sync pulse S20 indicative of the 

75 beginning of each TS packet is output to format conver- 
sion circuit 31 and PID detector circuit 32 when the syn- 
chronization code is detected. 
[0047] PID detector circuit 32 detects packet identifi- 
cation information PID added to each TS packet in 

20 accordance with the detection of sync pulse S20. 
Because the packet identification information PID is 
stored in an area a predetermined number of bits from 
the head of each TS packet, PID detector circuit 32 
counts the predetermined number of bits from sync 

25 pulse S20. and detects the stored packet identification 
information PID. Then, PID detector circuit 32 sends the 
detected packet identification information PID to PID 
lookup table 16A as a keyword. PID lookup table 16A 
receives this packet identification information PID, 

30 searches for address information for rearranging TS 
packets in accordance with the packet identification 
information PID for storage in memory 10, and sends 
resultant address information Saqs to format conver- 
sion circuit 31 . Format conversion circuit 31 receives the 

35 188-byte TS packet and the associated address infor- 
mation S ADS for each TS packet, adds additional unique 
information to each TS packet, and stores each TS 
packet to which additional information has been added 
at an address position indicated by the address informa- 

40 tion Sad S . 

[0048] Taking advantage of the fact that memory 10 
stores inf orma tion in units of 256 bytes, the additional 
information added by format conversion circuit 31 
includes 68 bytes before and after the 188-bytes in each 

45 TS packet as illustrated in Fig. 10. Additional informa- 
tion included in the 68 bytes to be added may include 
various kinds of information as illustrated in Fig. 10. 
"abs_sum_bgn" is information indicative of the start 
address of payload data of an associated TS packet, 

so and "abs_sum_end" is information indicative of the end 
address of the payload data, "payloadjength" is infor- 
mation indicative of the length of the payload portion of 
the TS packet, and "payload_ptr" is pointer information 
pointing to a head of the payload portion of the TS 

55 packet. Also, "PCR_pfcr" is a pointer information pointing 
to a head of program clock reference PCR in the TS 
packet, and is loaded with the value "OxfF* when no pro- 
gram clock reference PCR is included in the TS packet 



8 




EP0 942 



[0049] "PES_pyld_ptr is a pointer information point- 
ing to a head of a payload portion of a PES packet, and 
is loaded with the value "OxfT when no payload portion 
of a PES packet exists in the TS packet 
"PES_pckt_lngt__ptr is a pointer information pointing to 5 
a head position at which a length of a PES packet is 
stored, and is loaded with the value "OxfT when no pay- 
load portion of a PES packet exists in the TS packet 
"PESJidrJngtjJtr'' is a pointer information pointing to a 
position at which the length of a header of a PES packet w 
is stored, and is loaded with the value "OxfT when no 
header of a PES packet exists in the TS packet 
w splc_cntdwn" is pointer information pointing to a head 
position at which information on splice count down is 
stored, and is loaded with the value "OxfT when such 15 
information does not exist in the TS packet 
"splice_countdown" stores information indicative of the 
value of splice count down for the TS packet 
[0050] n PTS_ptr" is pointer information pointing to a 
head position at which time information PTS in the TS 20 
packet is stored, and is loaded with the value "OxfT 
when no time information PTS exists in the TS packet 
"DTS_ptr" is pointer information pointing to a head posi- 
tion at which time information DTS in the TS packet is 
stored, and is loaded with the value "OxfT when no time 25 
information TDS exists in the TS packet. "ALLptr" is 
pointer information pointing to a head of an access unit 
and is loaded with the value "OxfT if no access unit 
exists in the packet. "pre^PCR" is information indica- 
tive of the number of a TS packet in which the previous 30 
program clock reference PCR is stored, and 
"preY_SPCD" is information indicative of the number of 
a TS packet in which the previous splice count down is 
stored. Also, 1nput_ STC is the value of a system time 
clock STC when the TS packet is input and "PCR" is 35 
the value of program clock reference PCR in the TS 
packet 

[0051] By thus adding a variety of pointer and other 
information indicative of positions of stored information 
when a TS packet is stored in memory 10, CPU 7 can 40 
directly access desired parameters to be used in the 
splicing operation. Thus, the TS packet can be handled 
as if it were an elementary stream by reading data at 
desired positions in the TS packet. Also, with the value 
of the system time clock STC added as the time at 45 
which a TS packet was input a TS packet not subjected 
to a splicing operation can be output without causing the 
VBV buffer to fail, by referring to this input time to output 
the TS packet at timing a predetermined time period 
delayed from the input time. Thus, such TS packets only so 
require scheduling processing only for registering the 
input time. Format conversion circuit 31 adds such addi- 
tional information to each TS packet input thereto to 
produce recording data S21 which is supplied to mem- 
ory 10, and rearranged in accordance with the packet 55 
identification information PID for storage in memory 10. 
[0052] Next, the configuration of sync detector circuit 
30 will be described making reference to Fig. 11 in addi- 
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tion to Fig. 6. Each TS packet in transport stream S1 0 is 
an equal-length data packet including a synchronization 
byte. However, since the data code word used to incfi- 
cate the synchronization byte may also be used for 
other purposes, the same data code as that of the syn- 
chronization byte may appear in another portion of the 
TS packet. However, since all TS packets have the 
same length of 1 88 bytes, the synchronization bytes are 
positioned at regular intervals in transport stream S10. 
By performing a fly wheel processing in accordance 
with the regular positioning of the synchronization bytes 
in which the bytes are read as received, the synchroni- 
zation bytes can be correctly detected to produce a plu- 
rality of sync pulses S20 indicative of the timing of the 
starts of the respective TS packets. Sync detector cir- 
cuit 30 which relies on the fly wheel processing is con- 
figured as illustrated in Fig. 1 1 . 
[0053] In sync detector circuit 30, three states are 
employed in the course of detecting synchronization 
bytes positioned in transport stream S10. One is a hunt 
state, and the remaining two are an unlock state and a 
lock state. In the hunt state, sync detector circuit 30 has 
lost the position of a synchronization byte and is looking 
for it In the unlock state sync detector circuit 30 has 
detected a likely position of a synchronization byte but 
the determined position is not definite. In the lock state 
the determined position of a synchronization byte is def- 
inite. Sync detector circuit 30 begins with the hunt state, 
and transitions to the unlock state when it detects a byte 
considered likely to be a synchronization byte, and fur- 
ther transitions to the lock state when a predetermined 
condition is satisfied in the unlock state, and the position 
of the synchronization byte has been definitely deter- 
mined. Conversely, even once in the lock state or the 
unlock state, synch detector circuit 30 will transition to 
the hunt state rf it loses the synchronization byte. Sync 
detector circuit 30 can correctly detect the synchroniza- 
tion byte by reaching the lock state through the forego- 
ing state transitions. 

[0054] In sync detector circuit 30, transport stream 
S1 0 is first input to a comparator 40. The comparator 40 
compares a value in transport stream S10 inputted 
thereto with data "47H" which is the value employed as 
the data code of the synchronization byte, and outputs a 
logical output at level "H" if the value in transport stream 
S1 0 is coincident with "47^ and a logical output at level 
"L" if not coincident 

[0055] An AND circuit 41 takes a logical AND of state 
information DS-HT at level "H" incficative of the hunt 
state, output from a state decoder 88 later described, 
and the output of comparator 40. Because comparator 
40 outputs a logical output at level "H" rf it detects a syn- 
chronization byte "47H W from transport stream S10, 
AND circuit 41 outputs a logical output at level "H" when 
sync detector circuit is in the hunt state, and a synchro- 
nization byte is detected. The logical output at level "H" 
of AND circuit 41 is input to a reset terminal of a clock 
counter 44 as next unlock information DN-ULK. The 
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next unlock information DN-ULK is also input to a state 
encoder 56, later described to force a state change to 
the unlock state. When the next unlock information DN- 
ULK is generated, sync detector circuit 30 transitions to 
the unlock state to output state information DS-ULK 
indicative of the unlock state. 

[0056] A clock counter 44 cyclically counts from "0" to 
"188" bytes, and its count value is forcibly reset to "0" 
upon receipt of each next unlock information DN-ULK at 
level "H from each TS packet" Clock counter 44 outputs 
a sync pulse S20 when its count value is "0," and out- 
puts a pulse signal Sqet for determining whether or not 
a synchronization byte is definite when its count value is 
"188." For reference, the pulse signal Sqet indicates the 
timing at which the next synchronization byte should be 
detected after a synchronization byte has been 
detected. 

[0057] An AND circuit 42 determines whether or not 
comparator 40 has detected a synchronization byte 
when the pulse signal Sq^j is generated by taking a 
logical AND of the pulse signal S DET and the output 
from comparator 40. As a result, if comparator 40 has 
detected a synchronization byte at the time the pulse 
signal SDET was generated, AND circuit 42 outputs a 
logical output at level "H." A match counter 47 counts 
the number of pulses at level "H" output from AND cir- 
cuit 42 to count the number of times the synchronization 
byte has been detected at the proper timing, and out- 
puts the count value to a comparator 48. 
[0058] Comparator 48 receives a definition value 
d match supplied from CPU 7 through a latch circuit 46, 
and outputs a logical output at level "IT when the defini- 
tion value Dmaj-qh becomes equal to the count value of 
match counter 47. An AND circuit 49 takes a logical 
AND of the state information DS-ULK indicative of the 
unlock state and the output of comparator 48, and out- 
puts next lock information DN-LK at level "IT at the tim- 
ing comparator 48 outputs a logical output at level "H." 
The next lock information DN-LK is input to state 
encoder 56, later described. When the next lock infor- 
mation DN-LK is generated, sync detector circuit 30 
transitions to the lock state to output state information 
DS-LK indicative of the lock state. When the synchroni- 
zation byte is detected equal to or more than a predeter- 
mined number of times from the time the 
synchronization byte was first detected as counted in 
match counter 47, sync detector circuit 30 can transition 
to the lock state and output the sync pulse S20 accu- 
rately synchronized with the synchronization byte. 
[0059] In order to detect if a synchronization signal 
has been lost, an AND circuit 45 receives the output 
from comparator 40 through an inverting circuit 43 as 
well as the pulse signal Sqet, and takes a logical AND 
of these signals. In this event when the comparator 40 
outputs a logical output at level "L" and the timing the 
pulse signal Sqej is at level "H" (i.e., when the compa- 
rator 40 does not detect a synchronization byte at the 
expected timing), AND circuit 45 outputs a logical output 



at level "H." A miss counter 50 counts the number of 
times a synchronization byte does not come at the 
expected timing by counting the number of pulses at 
level "H" of AND circuit 45, and outputs the count value 

5 to a comparator 52. Comparator 52 receives a definition 
value d miss supplied from CPU 7 through a latch circuit 
51, and outputs a logical output at level "IT when the 
definition value D Mlss becomes equal to the count value 
of miss counter 50. An AND circuit 53 takes a logical 

70 AND of the state information DS-LK indicative of the 
lock state and the logical output of comparator 52, and 
outputs a logical output at level "H" if the status is in the 
lock state and comparator 52 outputs a logical output at 
level "H", indicating that a sync signal has been missed 

75 more than a predetermined number of times when in 
the lock state. 

[0060] An AND circuit 54 takes a logical AND of an 
output of AND circuit 45 and the state information DS- 
ULK indicative of the unlock state, and outputs a logical 

20 output at level "IT if the status is in the unlock state and 
AND circuit 45 outputs a logical output at level "IT, indi- 
cating that a single sync pulse has been missed when in 
the unlock state. An OR circuit 55 outputs next hunt 
information DN-HT at level "H" when either of the AND 

25 circuits 53, 54 outputs at level "H." The next hunt infor- 
mation DN-HT is input to the state encoder 56, later 
described. When the next hunt information DN-HT is 
generated, sync detector circuit 30 transitions to the 
hunt state and outputs the state information DS-HT 

30 indicative of the hunt state. In this way, sync detector cir- 
cuit 30 is adapted to again transition to the hunt state to 
look for a synchronization byte when the synchroniza- 
tion byte is not detected equal to or more than a prede- 
termined number of times at the expected timing of the 

35 synchronization byte, in the lock state, or when the syn- 
chronization byte is not detected at the expected timing 
in the unlock state. 

[0061] As described above, the next unlock informa- 
tion DN-ULK, the next lock information DN-LK, and the 
40 next hunt information DN-HT are converted into state 
information DS-ULK, DS-LK, DS-HT, respectively, after 
predetermined timing through the state encoder 56. a 
latch circuit 57 and the state decoder 58. 

45 (3) Configuration of PID lookup Table 

[0062] PID lookup tables 16A and 16B will be 
described making reference to Figs. 12 and 13, in addi- 
tion to Fig. 6. Because PID lookup tables 16A and 16B 

so have a similar configuration, only PID lookup table 16A 
will be described, it being understood that the descrip- 
tion applies equally well to Fig. 16B. 
[0063] PID lookup table 16A searches for, and pro- 
vides address information for rearranging and grouping 

55 TS packets in accordance with packet identification 
information PID and stores the rearranged TS packets 
in memory 10. The search for address information is 
started after a TS packet has been input to input proc- 
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essor 15 A, and must be completed by the time a next 
TS packet reaches input processor 1 5 A, so this next TS 
packet may be processed. Thus, fast operation is 
required. For this reason, PID lookup table 16A com- 
prises a plurality of tables that are used for the address 5 
search such that search processing is performed in par- 
allel. The plurality of tables allows for the search for 
address information associated with the packet identifi- 
cation information PID specified by input processor 15A 
at a higher speed. r 0 

[0064] Each of the plurality of tables provided in PID 
lookup table 16A is structured as shown in the memory 
map of Fig. 12. Specifically, in each of tables TB1 to 
TB4, address information is arranged in discrete infor- 
mation packets and stored for each packet identification 15 
information PID. The value of the packet identification 
information PID is stored at the head of each informa- 
tion packet as a search tag. For searching tables TB1 to 
TB4 in order to retrieve desired address information, a 
search tag is searched for to find an information packet 20 
in which address information corresponding to the 
desired packet identification information is stored. Once 
the appropriate information packet has been found, 
address information stored at and subsequent to the 
search tag within the information packet is sequentially 25 
read and output therefrom. 

[0065] In Fig. 12, "PID VAL" indicates the value of 
packet identification information PID used as a search 
tag; "W_ptr" indicates address information indicative of 
the write address at which an associated TS packet is to 30 
be stored in memory 10; and "Information" indicates 
address information to generate the additional informa- 
tion stored together with the TS packet. Memory 10 
stores TS packets in a ring buffer manner, and thus 
each address information is updated as required after it 35 
is read. 

[0066] The specific configuration of the apparatus for 
retrieving information from PID lookup table 16A will 
now be described making reference to Fig. 13. As is 
illustrated in Fig. 13, PID lookup table 16A comprises a *o 
plurality of reference to circuit elements for performing 
desired actions on tables TB1 to TB4 which store the 
aforementioned address information. First packet iden- 
tification information PID outputted from PID detector 
circuit 32 of input processor 15A is supplied to each of 45 
comparators 61 A to 61 D through a latch circuit 60. 
[0067] A search start pulse SSP output from PID 
detector circuit 32 together with the packet identification 
information PID is supplied to a counter 62 and a fine 
counter 63. Counters 62 and 63 are provided for gener- so 
ating an access position on each of the tables TB1 to 
TB4, where counter 62 generates upper, most signifi- 
cant bits of an access position and fine counter 63 gen- 
erates lower, less significant bits of the access position. 
If only the output of the counter 62 is used to specify 55 
access positions, positions are specified at desired 
search tag intervals in the tables TB1 to T64. Therefore, 
when a count interval for counter 62 is set to the interval 
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of search tags in tables TB1 to TB4, the location of the 
search tags in the tables TB1 to TB4 can be specified by 
merely employing the output of counter 62 and not 
including the output of fine counter 63. Upon receipt of 
a search start pulse SSP, counter 62 begins a counting 
operation, and outputs its count value CNT1 to an 
address generator 64. Address generator 64 generates 
the address of an access position specified by the count 
value CNT1 of counter 62, and outputs the address to 
each of tables TB1 to TB4. Thus, tables TB1 toTB4are 
accessed at their first search tags, and the values of 
packet identification information PID in the first search 
tag from each of the tables is output to comparators 6 1 A 
to61D, respectively. 

[0068] Each of comparators 61 A to 61 D compares the 
value of packet identification information PID supplied 
thereto through latch circuit 60 with the value of the 
packet identification information PID output from each 
table TB1 to TB4, and advances the count of the coun- 
ter 62 by one if none of the values are coincident. This 
counter advancing allows a next search tag storing 
packet identification information PID to be searched in 
each table. This operation is repeated until two values of 
the packet identification information PID (one from latch 
circuit 60, and one from one of the tables) are coinci- 
dent. If it is determined that two values of the packet 
identification information PID coincide, the comparator 
that has detected the desired PID information coinci- 
dence, and stops the counting operation of counter 62. 
Fine counter 63 then begins a fine counting operation. 
Simultaneously a selector 65 selects the table in which 
the coincidence was detected. Address information 
stored at the search tag onward is sequentially read by 
advancing the count of the fine counter 63 one by one 
since the count width of the fine counter 63 is equal to 
the information storing interval in each table TB1 to 
TB4. Thus, information associated with the desired PID 
information is output The read address information is 
output to format conversion circuit 31 of input processor 
15A as address information S ADS through selector 65 
and a latch circuit 66. 

[0069] When address information stored in tables T61 
to TB4 is to be updated, new address information is 
supplied to a data update circuit 67 which updates the 
address information stored in each of the tables based 
on update information D UP _o supplied from CPU 7. The 
updated address information is stored over previously 
stored address information in tables TB1 to TB4 through 
a switch 68, thereby allowing for the update of the 
address information. For setting an initial value of the 
address information stored in the tables TB1 to TB4, an 
initial value D [NT supplied from the CPU 7 is supplied to 
the tables TB1 to TB4 through the switch 68, and a stor- 
age location is specified through the address generator 
64, whereby the initial value D )NT can be loaded at a 
desired position in the tables TB1 to TB4. 
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(4) Configuration of Parser Unit 

[0070] Parser unit 17 will now be described making 
reference to Fig. 14, in addition to Fig. 6. As is shown in 
Fig. 6, parser unit 17 accesses memory 10 to parse TS 
packets which contain video data that is to be subjected 
to a splicing operation, and extracts a variety of coding 
parameters which have been added to encoded data 
during compression encoding and packetization. 
Parameter information to be extracted includes PES or 
TS parameters, including time information, such as 
presentation time stamp PTS, decode time stamp DTS, 
PCR, length of a PES packet, the length of a PES 
header, bit rate, VBV size brt_rate_extension, 
VBV_size_extension, closed_GOR 
temporary_reference, picture_coding_type, VBV_delay, 
top_fieid_first repeat_first_field, and so on. 
[0071] When an input transport stream is of a multi- 
program type, data streams having different packet 
identification information PID are mixed therein, so that 
a complicated operation is involved to extract parame- 
ters associated with each of these streams. However, 
because respective TS packets have been previously 
rearranged and stored in accordance with the packet 
identification information PID by the input processors, 
each rearranged stream can be parsed so that parame- 
ter information associated therewith can be readily 
extracted. 

[0072] Generally, there are at least two or more video 
data streams which may be subjected to a splicing oper- 
ation. For this reason, parser unit 17 must parse the 
foregoing parameters for at least two or more video data 
streams. Parser unit 1 7 parses a plurality of video data 
streams to be subjected to a splicing operation in time 
division processing to extract the parameters for each 
data stream. When data streams are parsed in time divi- 
sion processing, parser unit 17 must hold the result of 
the parsing operation on a particular data stream so far 
made when it proceeds to parse information from 
another stream, thus maintaining parallel collections of 
extracted parameters. For this operation, parser unit 17 
includes a status table 17A for storing unfinished pars- 
ing results. When parser unit 1 7 proceeds to parse a 
next data stream due to time division multiplex process- 
ing, a parsing result so far obtained is stored in the sta- 
tus table. 

[0073] The configuration of parser unit 1 7 is shown in 
Fig. 14. For example only, it will be assumed herein that 
a total number of streams to be subjected to a splicing 
operation is N, and to TS packets of these streams are 
added packet identification information PID as PID="1 ," 

"2," "N" for the sake of explanation. Parser unit 17 

includes status table 1 7A formed for each data stream 
(i.e., for each packet identification information) to store 
parsing results. Access to different portions of status 
table 1 7A is switched by a selector 1 7B, such that a por- 
tion of the table associated with a desired stream can be 
accessed in status table 17 A. 



[0074] First, a parser 1 7C reads from memory 1 0 data 
D TS1 of a TS packet to be subjected to a splicing opera- 
tion and having packet identification information PID set 
at "1 ". Selector 1 7B is controlled to connect parser 1 7C 

5 with a portion of table 17A having the packet identifica- 
tion information PID set at "1" in the status table 17 A. 
Parser 1 7C parses the syntax of the data Dr S1 of the TS 
packet in order to extract a variety of parameters as 
mentioned above. At the time a next data stream is to be 

to parsed, after the lapse of a predetermined time period 
from receipt of the first data stream, parser 17C stores 
the result of the parsing so far obtained in the portion of 
status table 17A having the packet identification infor- 
mation PID set at "1" via selector 17B. 

is [0075] Subsequently, parser 17C controls selector 
17B to connect parser 17C with a portion of status table 
17A having the packet identification information PID set 
at "2". Parser 17C reads data D TS1 of a TS packet hav- 
ing the packet identification information PID set at "2" 

20 from memory 10, and parses the syntax of the D TS1 
data in order to extract parameters as mentioned above 
for the data stream having packet identif ication informa- 
tion PID set at "2." Then, at the time the next data 
stream is to be parsed, parser 17C stores the result of 

25 the current parsing operation so far obtained in the por- 
tion of status table 17A having the packet identification 
information PID set at "2" via selector 17B. By subse- 
quently performing the processing as described above 
in a similar manner at every predetermined time, corre- 

30 sponding to the arrival of each data stream to be 
parsed, parser 17C parses the streams to be subjected 
to the splicing operation in accordance with a time divi- 
sion multiplexing scheme. 

[0076] As a result at the time the stream having the 
35 packet identification information PID set at T is again 
to be parsed, parser 17C controls selector 17B to 
access the portion of the table having the packet identi- 
fication information PID set at "1 " to extract the previous 
parsing result, and subsequently reads the data D TS1 of 
40 the next TS packet having the packet identification infor- 
mation PID set at "1" from memory 10 to continue the 
parsing operation from the point at which the parsing 
was previously interrupted. Then, at the time the next 
stream is to be parsed, parser 17C stores the result of 
45 the parsing operation so far obtained in the portion of 
the table having the packet identification information 
PID set at "1," and proceeds to parse the next data 
stream. By repeating the processing as descrfced 
above, parser 17C parses the data streams to be sub- 
so jected to the splicing operation in a time division multi- 
plexed fashion. When the parsing operation is 
eventually completed, the parsing results for each 
packet identification information PID stored in status 
table 17A are sent to buffer simulator unit 18. 

55 

(5) Configuration of Data Link Circuit 

[0077] Data link circuit 19 will be described, making 
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reference to Fig. 15 in addition to Fig. 6. In splicing 
apparatus 1 constructed in accordance with an embod- 
iment of the invention, in response to the parsing results 
received from buffer simulator 18, CPU 7 determines a 
splice point at which a splicing operation is to be per- 5 
formed. CPU 7 also determines whether or not blanking 
data and/or stuffing data should be inserted at the splice 
point. CPU 7 sends the determination results to data 
link circuit 19 as a data splicing instruction. Upon receipt 
of the data splicing instruction, data link circuit 19 exe- 
cutes the splicing operation for video data of streams to 
be subjected to the splicing operation. 
[0078] The determination as to whether or not blank- 
ing data and/or stuffing data should be inserted at the 
link point of the spliced data stream is made based on 
an occupancy of the VBV buffer on the receiver/decoder 
side upon receipt of the spliced data stream. Specifi- 
cally, if the splicing operation will cause an underflow of 
the VBV buffer that stores the spliced stream, blanking 
pictures may be inserted to increase the occupancy of 
the VBV buffer. Conversely, if the splicing operation will 
cause an overflow of the VBV buffer, stuffing data con- 
sisting of values "0" may be inserted to decrease the 
occupancy of the VBV buffer. In the example illustrated 
in the aforementioned Figs. 7A to 7C, since the VBV 
buffer may underflow as a result of a splicing operation, 
three blanking pictures are inserted between picture "n" 
and picture "rrf . Inserting these blanking pictures may 
in turn cause a slight overflow in the VBV buffer. There- 
fore, stuffing data is inserted with the last blanking pic- 
ture to reduce the occupancy of the VBV to the desired 
level. 

[0079] Referring to Figs. 19 and 20, the procedure for 
determining the number of blanking pictures and 
amount of stuffing data are to be inserted at the splice 
point will be more fully described. 
[0080] CPU 7 calculates the number of blanking pic- 
tures to be inserted between a last picture "m" in the 
data stream to be positioned before the splice point and 
the first picture "n" in the data stream to be positioned 
after the splice point in the splicing operation. This 
determination is made based upon the occupancy value 
m V{rr\) m of the VBV buffer of the last picture "nrV, the 
occtpancy value "V(n) w of the VBV buffer of the first pic- 
ture "n" and a number of encoding bits "Gtm)" gener- 
ated by the process of encoding picture m. These 
variables are obtained from buffer simulator 18. The 
determination is made so that the buffer occupancy 
when picture n is decoded is equal to the buffer occu- 
pancy that would exist if no splicing operation had taken 
place, and picture n were decoded during standard 
processing. These variables are also used to determine 
the number of stuffing bytes to be inserted in the blank- 
ing picture. Thus, the number of blanking pictures and 
stuffing bytes are selected so that the buffer occupancy 
at the beginning of the data stream positioned after the 
splice point matches the actual required and expected 
buffer occupancy of the data stream positioned after the 



splice point so that the VBV buffer does not underflow or 
overflow. 

[0081] As is shown in Fig. 19, and the flowchart of Fig. 
20, at step S1 the occupancy of the VBV buffer of a pic- 
ture that is to be decoded at time ^ is determined in 
accordance with the equation 

V(t n ) = V(m)-G(m)+Ft/30 , where Vft) is the occupancy 
of the VBV buffer at time t 1( and V(m) is the occupancy 
of the VBV buffer for picture "m*. G(m) is the number of 
encoding bits generated by the encoding process of 
encoding picture "m", and R/30 represents that a picture 
is output each 1/30 of one second, where "FT is the 
bitrate of the data streams. In Fig. 19, the value V(tj) is 
determined. V(t 1 ) is essentially the value of the VBV 
buffer at the last timing less the data removed for decod- 
ing, plus the data added to the VBV buffer for the next 
picture. 

[0082] Then, at inquiry step ST2 the calculated occu- 
pancy of the VBV buffer at time ti (Vft)) is compared to 
the desired occupancy of the VBV buffer at picture "n" to 
determine if the buffer occupancy at time t 1 is greater. If 
the inquiry is answered in the negative, and the occu- 
pancy of the VBV buffer is not greater, then the picture 
output at time t 1 is a blanking picture as shown at step 
ST3. Then at step ST4, the counter "x" is increased by 
1 , and the procedure returns to step ST1 , and the calcu- 
lation noted above is repeated for time t 2 and further 
time periods as is necessary. 

[0083] This procedure continues until the inquiry at 
step ST2 is answered in the affirmative, that is the occu- 
pancy of the VBV buffer at the presently measured tim- 
ing is greater than the desired occupancy of the VBV 
buffer at picture "n", control then passes to step ST5. 
This is shown in Fig. 19 at time tj, where V(t4) is greater 
than V(n). At step ST5, it is then determined that no 
additional blanking pictures are required, and the next 
picture that is output will be picture "n". 
[0084] Control then proceeds to step ST6, where a 
number of stuffing bytes necessary to reduce the actual 
VBV buffer occupancy to the desired VBV buffer occu- 
pancy of picture n is determined. This is necessary 
because the insertion of the third blanking picture may 
cause an overflow of the VBV buffer in the near future 
because the occupancy value V(tj) is greater than V(n). 
The number of required stuffing bytes is determined in 
accordance with the formula G(SF) = Vft^-Vfn) . Sim- 
ply, the number of stuffing bytes (G(SF)) equals the 
amount of the occupancy of the VBV buffer at time t* is 
greater than the desired occupancy of the VBV picture 
"n". After this determination, at step ST7, these stuffing 
bytes are added to the VBV buffer prior to the input of 
picture "n" so the desired VBV buffer occupancy is 
achieved. This is shown in Fig. 19 as the addition of 
bytes G(SF), so that the occupancy of the VBV buffer at 
ti equals the desired occupancy for picture N n N . Thereaf- 
ter, further pictures in the data stream are input to, and 
decoded from, the VBV buffer without danger that the 
buffer will underflow or overflow. 
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[0085] The specific configuration of data link circuit 1 9 
is illustrated in Rg. 15. Data link circuit 19 first inputs a 
data splicing instruction D, ST supplied thereto from CPU 
7 to an instruction buffer 70. The data splicing instruc- 
tion D| ST also includes information relating to locations 
in memory 1 0 at which data to be spliced in accordance 
with the splicing operation are stored, information on the 
amounts of blanking pages and stuffing data to be 
inserted, information on locations in memory 10 at 
which spliced data is stored, and so on. 
[0086] An instruction analysis circuit 71 reads and 
analyzes the data splicing instruction D|s T stored in 
instruction buffer 70, and outputs storage location infor- 
mation for video data to be subjected to a splicing oper- 
ation. The information obtained as a result of the 
analysis is output to a read address generator 73. 
Instruction analysis circuit 71 also outputs storage loca- 
tion information on the location where video data will be 
stored after the splicing operation to a write address 
generator 74, and outputs information indicative of the 
contents of the splicing processing procedure to a con- 
trol circuit 75. Control circuit 75 controls the general 
operation of data link circuit 19. Control circuit 75 sends 
control data in accordance with the contents of the splic- 
ing processing procedure supplied thereto from instruc- 
tion analysis circuit 71 to a data processing circuit 76 
and a selector 77. Data processing circuit 76 and selec- 
tor 77 execute the data splicing processing procedure 
as instructed by CPU 7. Control circuit 75 also sends 
read/write (W/R) mode information for specifying a read 
mode or a write mode to memory 10 simultaneously 
with the output of an address from read address gener- 
ator 73 or write address generator 74. 
[0087] Read address generator 73 generates address 
information indicative of locations at which video data is 
stored in memory 10 based on location information for 
the video data to be subjected to the splicing operation, 
and sends these addresses to memory 10 as a read 
address D ADR1 . Video data DA and DB to be subjected 
to the splicing operation are read from the memory 10 
based on the read address D ADR1 and mode informa- 
tion W/R output from control circuit 75. When the video 
data DA and DB are read from memory 1 0, pointer infor- 
mation stored together with associated TS packets are 
used to read the desired video data from predetermined 
positions within the TS packets. The video data DA and 
DB read in this manner comprise video data in a form 
similar to that of elementary stream data. Video data DA 
and DB, read from memory 10 and to be subjected to 
the splicing operation, are input to data buffers 78, 79, 
respectively. Blanking data D^ generated by blanking 
generator 20 is also input to a data buffer 80. 
[0088] Selector 77 selects data to be processed by the 
splicing operation based on control data forwarded from 
control circuit 75, and stores the selected data in a data 
buffer 81 . More specifically, selector 77 reads the video 
data DA and DB as required for the splicing operation 
that are stored in data buffers 78, 79. The selected 
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video data read out from the respective buffers is then 
stored in data buffer 81 . Selector 77 then reads a prede- 
termined number of sheets of blanking data D BLK stored 
in the data buffer 80 and stores the read out blanking 

5 data D BLK in data buffer 81 as well. Finally, a desired 
amount of stuffing data D SF produced by stuffing gener- 
ator 21 is retrieved and is also stored in data buffer 81 . 
The amount of blanking data and stuffing data is deter- 
mined as described above. 

10 [0089] Data processing circuit 76 then reads video 
data DA and DB, blanking data D BLK and stuffing data 
D SF stored in data buffer 81 , based on control data from 
the control circuit 75, and splices these data portions 
together to produce a spliced video data sequence 

is which is then transformed into TS packetized spliced 
video data DA+B. The TS packetized spliced video data 
DA+B is again stored in data buffer 81 . Consequently, 
the spliced video data DA+B is read from data buffer 81 
and supplied to memory 10 together with a write 

20 address D ADW1 generated by write address generator 
74 and mode information W/R indicating a write opera- 
tion, and stored at a location specified by the write 
address D ADW1 . 

[0090] When a plurality of data splicing instructions 
25 D| ST are fed to instruction buffer 70, control circuit 75 
outputs a read instruction to instruction buffer 70 to read 
each next data combination instruction, one at a time, 
and proceeds with the processing in a similar manner 
for each data splicing instruction. Data link circuit 19 
30 reads the video data DA and DB to be subjected to a 
splicing operation from memory 10 based on a data 
splicing instruction D, ST from CPU 7, retrieves the 
blanking data D BLK and stuffing data D SF if required, 
and links these data to produce a spliced video data 
35 DA+B which is then stored again in memory 1 0. 

(6) Method of Generating Blanking Data 

[0091 ] A method of generating blanking data DBLK in 
40 the blanking generator 20 will now be described, refer- 
ring once again to Rg. 6. Blanking generator 20 is 
adapted to produce blanking data Dbl K by consisting all 
macroblocks only of DC values for intra-frame coded 
pictures. Also, for inter-frame predictive coded pictures 
45 subsequent to the intra-frame coded pictures, the blank- 
ing generator 20 produces blanking data D BLK by set- 
ting a differential value between a macrobfock and a 
reference macroblock and a motion vector to zero or by 
forming a picture of skipped macroblocks. 

50 

(7) Configuration of Output Processor 

[0092] Output processor 23 will now be described 
making reference to Rg. 16 in addition to Rg. 6. Output 
55 processor 23 reads and outputs TS packets of a spliced 
program and TS packets of other programs to be multi- 
plexed together with the spliced program from memory 
10 based on a scheduling fist created by the scheduler 
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circuit 24 to produce a multiplexed transport stream 
Squt- 

[0093] TS packets of programs not subjected to splic- 
ing are free from any processing within splicing appara- 
tus 1. Such TS packets may be output from splicing 5 
apparatus 1 subject only to a delay corresponding to a 
system delay caused by splicing apparatus 1 so that 
these TS packets are output at a proper timing as com- 
pared with TS packets that are subjected to a splicing 
operation. For providing such a delayed output if the 
time a TS packet was input to splicing apparatus 1 is 
known, the TS packet may be output at a desired time 
according to the system delay. Thus, once the system 
delay has elapsed after the input time for a particular TS 
packet the delayed TS packet may be output, realizing 
the delayed output For this purpose, a system time 
dock STC is added to each of the TS packets in the 
input processors 15 A, 15B when input to splicing appa- 
ratus 1. The input time is thus registered in each TS 
packet such that the value of the system time dock 
STC indicative of the input time is used to determine 
output time information in the scheduling list. 
[0094] The configuration of output processor 23 for 
performing such processing will be described making 
specific reference to Fig. 16. As illustrated in Fig. 16, in 
output processor 23, a scheduling list data 0 SLST 
received from scheduler circuit 24 is input to a list buffer 
90. The scheduling list stored in list buffer 90 indudes 
information for specifying the output time information for 
each TS packet to be output The output time informa- 
tion consists of the value of the system time dock STC 
indicative of the input time of the TS packet. List buffer 
90 reads the scheduling list in response to a read oper- 
ation specified by a read pointer 91 , and sends the entry 
information in the read list to an address generator 92, 
and sends output time information D TO to a comparator 

94 through a latch drcuit 93. 

[0095] Address generator 92 generates a read 
address D ADR2 for a TS packet specified by the entry 
information supplied thereto from list buffer 90, and sup- 
plies the read address D ADR2 to memory 10. In 
response, a TS packet D TS2 to be output from splidng 
apparatus 1 specified by the entry information is read 
from memory 10. A buffer 95 receives the TS packet 
DJS2, and writes the TS packet Qy S2 in an area of buffer 

95 specified by a write counter 96. 
[0096] A delay correction drcuit 98 is loaded with a 
current value of the system time dock STC. Delay cor- 
rection drcuit 98 subtracts the value of the system delay 
as a result of propagation of the signal through splidng 
apparatus 1 from the value of the system time clock 
STC to derive the value of a corrected system time clock 
STC which is output to comparator 94 as time informa- 
tion D STC . 

[0097] Comparator 94 determines whether or not the 
time information D STC output from delay correction dr- 
cuit 98 matches the output time information D TO of the 
TS packet supplied thereto through latch drcuit 93. If 



the two time information match, an output signal at level 
"H" to a read counter 97 is output from comparator 94. 
Thus, it is determined that the corrected time informa- 
tion D S tc is coincident with the output time information 
D TO . In this case, the delayed time from the input of the 
TS packet has been reached. 
[0098] A read counter 97 specifies an area of buffer 95 
from which information is to be read by outputting a con- 
trol signal for spedfying a read area to buffer 95 in 
response to an output signal from comparator 94. Con- 
sequently, as buffer 95 reads TS packets in response to 
the control signal, the TS packets specified by the 
scheduling list is output from output processor 23. 
[0099] When buffer 95 completes a read operation, 
read counter 97 notifies read pointer 91 of the comple- 
tion of the read operation. In response to this notifica- 
tion, read pointer 91 instructs list buffer 90 to read the 
next entry information and the output time information 
D TO - Consequently, the processing as described above 
is repeated in order to read consecutive TS packets 
specified by the scheduling list in order, thereby output- 
ting the transport stream Squt which has multiplexed 
therein TS packets of a spliced program and TS packets 
of other programs not subjected to a splidng operation. 

(8) Processing Procedure for Splidng Operation 

[0100] A processing procedure for performing the 
splidng operation on accordance with an embodiment 
of the invention will now be described making reference 
to the flow chart of Fig. 17. As illustrated in Fig. 17, the 
procedure begins at step SP1 , and at step SP2, each of 
a plurality of TS packets of received input transport 
streams S10, S11 are rearranged in accordance with 
packet identification information PID by input proces- 
sors 15 A, 15B. The rearranged TS packets are then 
stored in memory 10 in the rearranged form in accord- 
ance with each packet identification information PID. 
Processing then proceeds to step SP3. At step SP3, 
parser unit 17 of splidng apparatus 1 parses the syntax 
of the two source video streams of video data to be sub- 
jected to a splidng operation, as specified by host com- 
puter 2. At next step SP4, buffer simulator unit 18 of 
splidng apparatus 1 analyzes the amount of code that 
would be generated in the VBV buffer when the video 
data to be subjected to splidng is input thereto, based 
on the parsing result from parser unit 1 7. 
[01 01 ] Upon completion of the above steps, the splic- 
ing apparatus 1 simultaneously proceeds to steps SP5 
and SP10 to perform respective processing in parallel. 
At step SP5, CPU 7 determines how splidng processing 
should be performed on the source video stream to be 
subjected to splidng to generate splidng instructions 
based on the analysis result of buffer simulator 18. CPU 
7 in turn controls blanking generator 20 to generate a 
required number of blanking pictures D BLK which are to 
be inserted at a splice point between two data streams 
to be spliced together, based on the splidng instruction. 
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At next step SP6, data fink circuit 19 reads video 
streams DA and DB to be subjected to splicing from 
memory 10, and splices video data DA and DB while 
inserting the blanking picture and stuffing bits D SF 
as appropriate to produce spliced video stream DA+B. 
This linked video data is again transformed into TS 
packets and stored in memory 10. At next step SP7, 
time stamp regenerator 22 adds new time stamps to 
each of the TS packets positioned after the splice point 
such that the time stamps are continuous from before 
until after the splice point 

[0102] While steps SP5-SP7 are being performed, at 
step SP10, scheduler circuit 24 schedules the output 
timing for TS packets which are to be output from splic- 
ing apparatus 1. A scheduling list indicative of the out- 
put scheduling is created. Since splicing apparatus 1 
multiplexes and outputs the TS packets of other video 
streams that have not been subject to a splicing opera- 
tion, instead of only outputting the TS packets of the 
spliced video stream DAB, the output timing for all TS 
packets to be output are defined in the scheduling list. 
[0103] At step SP8, output processor 23 reads TS 
packets specified by the scheduling list from memory 10 
in the listed order, and outputs the read out TS packets 
at the specified timing. The scheduled output timing is 
based upon the scheduling list. An output transport 
stream Squt & produced, and which includes TS pack- 
ets of the spliced video stream DAB, and TS packets of 
the video data that have not been subject to a splicing 
operation, multiplexed therein. 
[0104] At next step SP9, PCR regenerator 25 corrects 
the value of the program clock reference PCR such that 
new program clock reference PCR added to transport 
stream Squt output from output processor 23 is com- 
pletely continuous. Thus, a transport stream Squt is 
produced and output After the processing at step SP9 
ends, splicing apparatus 1 returns to step SP1 to per- 
form a further splicing operation, or to terminate opera- 
tion. 

[0105] Splicing apparatus 1 is adapted to perform a 
splicing operation through a sequence of processing 
including storage of input transport streams, parsing of 
data streams to be subjected to splicing, execution of an 
actual splicing operation without decoding and re- 
encoding the transported data, scheduling for TS pack- 
ets to be output and outputting of TS packets based on 
the scheduling. 

[0106] Figs. 18A to 181 illustrate timing charts for 
respective processing by the various described compo- 
nents of splicing apparatus 1 . As illustrated in the afore- 
mentioned flow chart in splicing apparatus 1, TS 
packets are output therefrom, in accordance with a 
sequence of processing performed in the respective 
components. For this reason, splicing apparatus 1 gen- 
erates a system delay as shown in Figs. 18A to 181. In 
Figs. 1 8A to 1 81, same data belonging to a similar group 
is represented by the same hatching. As can be seen 
from the timing chart data P, which is stored in the 



memory 10 by input processor 15A (or 15B) at time 
point t1 0, is output from the splicing apparatus 1 at time 
point t1 1 , so that a system delay /tt (=t1 1-t10) exists. 
Therefore, delay correction circuit 98 in the output proc- 
5 essor 23 offsets the value of the system time clock STC 
by this system delay /$t Thus, TS packets that are sub- 
jected to a splicing operation, and TS packets that are 
not subjected to a splicing operation are output from 
splicing apparatus 1 after a similar delay. 

10 

(9) Operation and Effects 

[01 07] In splicing apparatus 1 configured as described 
above in accordance with an embodiment of the inven- 
ts tion, multi-program transport streams S10, S11, in 
which digital video data of a plurality of programs are 
multiplexed, are input to input processors 15 A, 15B. 
Input processors 15 A, 15B rearrange respective TS 
packets from transport streams S10, S1 1 in accordance 
20 with the packet identification information PID and store 
the rearranged TS packets in memory 10 according to 
each packet identification information PID, to reconfig- 
ure and group TS packets for each program. 
[01 08] For actually performing the splicing operation, 
25 parser unit 17 reads TS packets of video data to be sub- 
jected to the splicing operation, and parses a variety of 
syntax parameters added to the TS packets during 
compression encoding and packetization. Buffer simu- 
lator unit 18 receives the result of the parsing, and sim- 
30 ulates how the VBV buffer on the receiver side would 
behave when data streams that are to be subjected to 
splicing are received. 

[01 09] CPU 7 receives the result of the simulation per- 
formed by buffer simulator unit 18, determines which 

35 appropriate data combination processing should be 
performed on the data streams to be subjected to splic- 
ing without causing the VBV buffer to overflow or under- 
flow, and sends the determination result to data link 
circuit 19 as a splicing instruction. 

40 [OHO] Data link circuit 19 reads TS packets of the 
streams to be subjected to the splicing operation based 
on the data splicing instruction as received from CPU 7, 
and generates blanking pages D BLK and stuffing bytes 
D SF as appropriate. Data link circuit 1 9 performs a splic- 

45 ing operation by splicing the appropriate packets and 
data, and transforms the spliced data back into TS 
packets which are again stored in memory 10. 
[011 1] Scheduler circuit 24 schedules the output tim- 
ing for the spliced TS packets based on the result of 

so analysis performed by buffer simulator unit 18 and the 
contents of determination for data combination made by 
CPU 7. Scheduler circuit also schedules the output tim- 
ing for TS packets of other streams not subjected to a 
splicing operation, if they are to be multiplexed and out- 

55 put together, with the spliced TS packets. 

[0112] Output processor 23 reads TS packets from 
memory 10 to be output from splicing apparatus 1 
based on a scheduling list as received from scheduler 
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circuit 24, and outputs the TS packets at the specified 
output timing. This results in a transport stream Sq UT 
which has multiplexed therein the spliced TS packets 
and the TS packets of the other data streams not sub- 
ject to a splicing operation. 

[01 1 3] Splicing apparatus 1 demultiplexes and classi- 
fies the input transport streams S10, S11. and stores 
the individual data streams in the memory 10. Thereaf- 
ter, memory 1 0 is commonly accessed by the respective 
components of splicing apparatus 1 to perform analysis 
of the streams, execution of a splicing operation, and 
outputting of spliced data streams, thereby making it 
possible to reacfily carry out the splicing operation even 
with video data which are packetized for transmission. 
[0114] Also, in splicing apparatus 1, when respective 
TS packets of the transport streams S10, S11 are 
stored in memory 10, pointer information is added to 
each TS packet to point to positions at which associated 
information are contained within the packet. Accord- 
ingly a desired portion in a TS packet can be easily 
accessed by referring to the appropriate pointer infor- 
mation. It is therefore possible to handle the TS packets 
as if they were in the format of elementary streams with- 
out the need for actually disassembling and decoding 
them into elementary streams. 
[01 1 5] Further, in splicing apparatus 1 , when transport 
streams S10, S11 are stored in memory 10, an input 
time thereof is added to the transport streams. There- 
fore, if the transport streams S10, S1 1 are output at a 
delayed timing equal an inherent system delay from the 
input time, they can be property output while preventing 
the VBV buffer from failing without the need for resched- 
uling the output thereof. 

(10) Other Embodiments 

[0116] While the foregoing embodiment has been 
described for the case where TS packets of a spliced 
stream are multiplexed with TS packets of other streams 
and the multiplexed transport stream is output, the 
present invention is not limited to this. Alternatively, the 
TS packets of the spliced stream only may be output. 
[01 1 7] Also, while in the foregoing embodiment each 
of the components has been described as being an 
independent module, the present invention is not limited 
to this configuration, but some of the components may 
be collected and formed by a single module. 
[0118] Further, in the foregoing embodiment single 
memory 10 can be commonly accessed by the respec- 
tive components through bus 9 in order to absorb 
processing times in the respective components. The 
present invention, however, is not limited to this configu- 
ration, and alternatively, a first in first out (FIFO) buffer 
may be provided between the respective components to 
absorb the processing times in the respective circuit 
blocks. 

[0119] Further, in the foregoing embodiment input 
transport streams are rearranged in accordance with 



the packet identification information PID and grouped 
and stored in memory 10 according to packet identifica- 
tion information PID to classify and rearrange the trans- 
port streams. The present invention is not limited to 

5 such a manner of classification. Alternatively, the input 
transport streams may be stored in memory in their 
received groupings or order, and be classified in accord- 
ance with pointer information based on the packet iden- 
tification information PID. 

w [0120] Further, in the foregoing embodiment when 
the input transport streams are demultiplexed, and the 
data for each stream is stored together, pointer informa- 
tion indicative of storage locations for a variety of infor- 
mation is added to each stream such that the streams 

75 are disassembled into pseudo elementary streams. The 
present invention, however, is not limited to such 
pseudo disassemble. Alternatively, the respective 
streams may be actually disassembled into elementary 
streams. 

20 [0121] Further, while the foregoing embodiment has 
been described for parallel use of four tables TB1 to 
TB4 in the PID lookup tables 16A, 16B, the present 
invention is not limited to this particular number of 
tables. Any number of parallel tables may be used. In 

25 addition, the PID lookup table may be structured by 
direct mapping in accordance with a cache scheme, or 
N-way associative, by way of example. 
[0122] Further, while the foregoing embodiment has 
been described for the case where an input time is reg- 

30 istered in the scheduling list, the present invention is not 
limited to the registration of the output time in the sched- 
uling list. Alternatively, the output time may be regis- 
tered in each TS packet as part of additional 
information. 

35 [0123] According to embodiments of the present 
invention as described above, respective encoded video 
data streams within an input transport stream are disas- 
sembled into respective pseudo original elementary 
streams and stored in storage means. Tj^eamount of 

40 jxxje that.will.be generated in a receiver , s^V biif^Br a 
streams to be subject Jo.splicing linkage in the plurality 
of elementary streams is analyzed, and the streams to 
be subjected to a splicing procedure are spliced 
together on the basis of the result of the analy sis. A 

45 desired amount of data is inserted at a splice point" 
between the two data streams to be spliced to produce 
a spliced video data stream. The spliced video stream is 
output in accordance with output timing determined on 
the basis of the amount of code to be generated for the 

so spliced video data stream. It is thereby possible to read- 
ily carry out data connection processing even with video 
data which is packetized for transmission. 
[0124] Although particular embodiments have been 
described herein, it will be appreciated that the irtven- 

55 tion is not limited thereto and that many modifications 
and additions thereto may be made within the scope of 
the invention. For example various combinations of the 
features of the following dependent claims can be made 
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with the features of the independent claims without 
departing from the scope of the present invention. 
[0125] Further, since certain changes may be made in 
carrying out the above method and in the constructions 
set forth without departing from the spirit and scope of s 
the invention it is intended that all description shown in 
the accompanying drawings shall be interpreted as 
illustrative and not in a limiting sense. 
[0126] It is also to be understood that the following 
claims are intended to cover all of the generic and spe- 10 
cific features of the invention herein described and all 
statements of the scope of the invention which, as a 
matter of language, might be said to fall therebetween. 

Claims 75 

1 . A video splicing apparatus for receiving a transport 
stream including a plurality of packetized encoded 
video data streams, and for splicing said encoded 
video data streams to generate a spliced video data 20 
stream, comprising: 



2. The video splicing apparatus according to claim 1 , 
wherein: 

55 

said input processing means rearranges said 
respective encoded video data streams in 
accordance with packet identification informa- 



tion while adding pointer information to each of 
said encoded video data streams, and stores 
said encoded video data streams in said stor- 
age means to disassemble said respective 
encoded video data streams into said pseudo- 
elementary streams. 

3. The video splicing apparatus according to claim 2, 
wherein: 

said input processing means comprises a plu- 
rality of tables having address information 
arranged in accordance with the packet identi- 
fication information corresponding to storage 
locations of said storage means, and wherein 
said video splicing apparatus retrieves address 
information corresponding to packet identifica- 
tion information of an input data stream while 
referencing said plurality of tables in parallel, 
and rearranges said respective encoded video 
data streams in accordance with the packet 
identification information and stores the rear- 
ranged video data streams in said storage 
means based on said address information. 

4. The video splicing apparatus according to any pre- 
ceding claim, wherein: 

said data processing means inserts a desired 
number of blanking pictures and stuffing bits as 
said additional data such that a buffer in a 
decoder that will receive and decode the 
spliced data stream side does not overflow or 
underflow, based on the amount of data that 
would be generated in said decoder for each of 
said data streams subjected to the splicing 
operation. 

5. The video splicing apparatus according to any pre- 
ceding claim, wherein: 

said analysis means analyzes at least two or 
more video data streams to be subjected to 
splicing in a time division manner. 

6. The video splicing apparatus according to any pre- 
ceding claim, wherein: 

said output processing means further includes 
time stamp adding means for adding new time 
stamps such that said time stamps are continu- 
ous before and after said splice point in said 
spliced video data stream. 

7. The video splicing apparatus according to any pre- 
ceding claim, wherein: 

said output processing means further includes 
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input processing means for disassembling 
each of said plurality of packetized encoded 
video data streams in said transport stream 25 
into a pseudo-elementary stream before pack- 
etization, and storing said disassembled 
pseudo-elementary streams in predetermined 
storage means; 

analysis means for analyzing the amount of 30 
coded bits of two data streams of said elemen- 
tary streams stored in said storage means that 
would be generated upon decoding upon 
receipt of the two data streams to be subjected 
to a splicing operation; 35 
data processing means for reading said data 
streams to be subjected to said splicing opera- 
tion from said storage means, splicing said 
streams, and inserting a desired amount of 
additional data at a splice point based on the 40 
result of the analysis by said analysis means to 
produce a spliced video data stream, and stor- 
ing said spliced video data stream in said stor- 
age means; and 

output processing means for determining out- 45 
put timing for said spliced video data stream 
based on said amount of coded bits deter- 
mined by said analysis means, and outputting 
said spliced video data stream read from said 
storage means based on said determined out- so 
put timing. 
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program clock reference correcting means for 
correcting a program clock reference in said 
output spliced video data stream. 



A2 




inserting a desired amount of additional data at 
a splice point based on the result of said analy- 
sis to produce a spliced video data stream, 



8. The video splicing apparatus according to claim 7, 5 
wherein: 

said program clock reference correcting means 
corrects said program clock reference based 
on a difference in time between said output tim- 10 
ing after splicing and an output timing that 
would be used if the data had not been spliced. 



storing said spliced video data stream; 

determining output timing for said spliced video 
data stream based on said determined amount 
of coded bits; and 

outputting said spliced video data dream 
based on said determined output timing. 



9. Trie video splicing apparatus according to any pre- 
ceding claim, wherein: 

said input processing means stores an input 
time at which each packet of said respective 
encoded video data streams was input associ- 
ated with each packet of said encoded data 
streams. 

10. The video splicing apparatus according to claim 9, 
wherein: 

when said encoded video data streams not 
subjected to a splicing operation are output 
together with said spliced video data stream, 
said output processing means specifies output 
timing for said encoded video data stream not 
subjected to the splicing operation, said output 
timing being related to said input time. 

11. A video splicing method for receiving a transport 
stream including a plurality of packetized encoded 
video data streams, and for splicing said encoded 
video data streams to generate a spliced video data 
stream, comprising the steps of: 

disassembling each of said plurality of pack- 
etized encoded video data streams in said 
transport stream into a pseudo-elementary 
stream before packetization; 

storing said disassembled pseudo-elementary 
streams; 

analyzing the amount of coded bits of two of 
said pseudo-elementary streams that would be 
generated upon decoding upon receipt of the 
two data streams to be subjected to a splicing 
operation; 

reading said data streams to be subjected to 
the splicing operation; 

splicing said data streams; 



12. The video splicing method according to claim 11, 
is wherein: 

said respective encoded video data streams 
are rearranged in accordance with packet iden- 
tification information while adding pointer infer- 
20 mation to each of said encoded video data 

streams, and said encoded video data streams 
are disassembled irrto-pseudo elementary 
streams and are stored. 

25 13^ The video splicing method according to claim 12, 
further comprising the steps of: 

providing a plurality of tables having address 
information corresponding to storage locations 
30 of said encoded video data streams arranged 

in accordance with the packet identification 
information; 

retrieving address information while referenc- 
ing said plurality of tables in parallel; 
35 rearranging said respective encoded video 

data streams in accordance with the packet 
identification information and 
storing the rearranged video data streams 
based on said address information. 

40 

14. The video splicing method according to any of 
claims 1 1 to 13, further comprising the step of: 

inserting a desired number of blanking pages 
45 and stuffing data such that a buffer in a decoder 

that will receive and decode the spliced data 
stream side does not overflow or underflow, 
based on the amount of data that would be 
generated in said decoder for said data 
so streams subjected to the splicing operation. 

15. The video splicing method according to any of 
claims 1 1 to 14, further comprising the step of: 

55 analyzing at least two or more video data 

streams to be subjected to splicing in a time 
division manner. 
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16. The video splicing method according to any of 
claims 11 to 15, further comprising the step of: 



buffer which stores said spliced video stream 
does not overflow or underflow. 



adding new time stamps to said spliced video 
data stream such that said time sta mps are 
continuous before and after said splice point in 
said spliced video data stream. 

17. The video splicing method according to any of 
claims 1 1 to 16, further comprising the step of: 

correcting a program clock reference in said 
output spliced video data stream. 

18. The video splicing method according to claim 17, 
wherein: said program dock reference correcting 
step corrects said program clock reference based 
on a difference in time between said output timing 
after splicing and an output timing that would be 
used if the data had not been spliced. 



22. The splicing apparatus according to claim 21, 
5 wherein: 

said parser means simulates a bit occupancy 
value of a codec buffer holding said first coded 
stream and a bit occupancy of a codec buffer 
10 holding said second coded stream based on 

the result from said parsing means. 

23b The splicing apparatus according to claim 22, 
wherein: 

15 

said control means controls said splice means 
so that said bit occupancy value of said codec 
buffer holding said spliced video data stream 
equals said bit occupancy value of said codec 
20 buffer holding said second coded stream. 



19. The video splicing method according to any of 
claims 1 1 to 18, further comprising the step of: 



24. The splicing apparatus according to claim 23 
wherein: 



storing an input time at which each packet of 25 
said respective encoded video data streams 
was input associated with each packet of said 
encoded data streams. 

20. The video splicing method according to claim 19, so 
wherein: 

when said encoded video data streams not 
subjected to a splicing operation are output 
together with said spliced video data stream, 35 
output timing for said encoded video data 
stream not subjected to splicing is specified in 
accordance with said input time. 



said dummy data comprises at least one of a 
blanking picture and stuffing bits. 

25. The splicing apparatus according to claim 24, 
wherein: 

said control means calculates a number of said 
blanking pictures and amount of said stuffing 
bits based on a bit occupancy value of a last 
picture of said first stream and a bit occupancy 
value of a first picture of said second stream. 

26. The splicing apparatus according to claim 25, 
wherein: 



21. A splicing apparatus for splicing together a first 40 
coded video stream and a second coded video 
stream, comprising; 

parser means for parsing a syntax of said first 
coded video stream and a syntax of said sec- 45 
ond coded video stream: 
splice means for splicing said first coded video 
stream and said second coded video stream at 
a splicing point to generate a spliced video 
stream; and so 
control means for generating a splicing instruc- 
tion to be supplied to said splice means in 
accordance with a command from said parser 
means for controlling said splice means based 
on said splicing instruction so as to insert 55 
dummy bits between said first coded video 
stream and said second coded video stream in 
said spliced video stream so that a coding 



said splice means inserts said blanking pic- 
tures in order to increase the bit occupancy 
value of said codec buffer holding said spliced 
video stream, and stuffs said stuffing bits in 
order to decrease the bit occupancy value of 
said codec buffer holding said spliced video 
stream. 

27. The splicing apparatus according to claim 26, 
wherein: 

said control means determines the amount of 
stuffing bits to be stuffed after the number of 
said blanking pictures is determined. 

28. The splicing apparatus according to claim 22, 
wherein: 

said control means controls said splice means 
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so that variations in the occupancy value of the 
codec buffer holding said spliced video stream 
agree with variations of said occupancy value 
of said codec buffer holding said second coded 
stream. 



5 



splice means for switching said first coded 
video stream and said second coded video 
stream at a splicing point to generate a spliced 
video stream; 



ond coded video stream; 



29. The splicing apparatus according to claim 21, 
wherein: 



said control means revises time stamps of said 
spliced video stream so that said time stamps 
of said second coded video stream within said 
spliced video stream are continuous from time 
stamps of first coded video stream within said 
spliced video stream. 



10 



control means for controlling said splice means 
so that variations in a buffer occupancy of the 
second coded video stream in said spliced 
video stream agree with variations of a buffer 
occupancy that would be present as a result of 
an original second coded video stream sup- 
plied to said splicing apparatus if said second 
coded video stream were not subjected to the 
splicing operation. 



75 



30. The splicing apparatus according to claim 21, fur- 
ther comprising: memory means for storing said 
first coded stream and said second coded stream; 

wherein said control means adds pointer 20 
information to first and second coded streams, 
wherein said pointer information indicates memory 
address of codec parameters of said first and sec- 
ond coded streams stored in said memory means, 
and wherein said splicing instruction is generated 25 
based on said codec parameters which are read 
out from said memory means by using said pointer 
information. 

31. A splicing apparatus for splicing together a first 30 
coded video stream and a second coded video 
stream, comprising; 

parser means for parsing a syntax of said first 
coded video stream and a syntax of said sec- 35 
ond coded video stream, 
splice means for switching said first coded 
video stream and said second coded video 
stream at a splicing point to generate a spliced 
video stream; 40 
control means for controlling said splice means 
to insert a number of dummy bits between said 
first coded video stream and said second 
coded video stream in said spliced video 
stream so that a buffer occupancy of a buffer 45 
holding said second coded video stream in said 
spliced video stream matches a buffer occu- 
pancy of said second coded video stream that 
would be generated if said second coded video 
stream were not spliced to said first coded so 
video stream. 

32. A splicing apparatus for splicing a first coded video 
stream and a second coded video stream, compris- 
ing: 55 

parser means for parsing a syntax of said first 
coded video stream and a syntax of said sec- 
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